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This paper proposes an evkluation design for Mercer 
County, Hes^t Virgiiia*s state funded earlj childhood education 
program, v^ich y^s initiated to replaced injdependent kindergarten 
prograns. An introductory discussion listslthe kroad goalst of the 
pro^ran, three data collectj^on tia^e schedules, program variables that 
define the ttOdel^bf the program, and instrments available for 
measuring these defining variables to determine the etactness of fit 
of^^tji^progran to its model. evaluati^m design is described in 
terms of--t1) .prograta ^oajs and cfbjective^ involving the ^tudenjts, 
faculty, lealrndng m^atei^^alSf and parental invoj^vement; (2) data 
collection methods; (3^' criteria for judging the program; and (U) 
decisions to be reached as a r^esult ofithe evaloationt A conclusion 
lists the goals of the e valuatiSlr^rogram. (SB) \ 
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West Virginia Legislature passed a bill to establish 
fund a statewide.Early Chillhood Education Program (ECEP). One of the 
objectives of the program was that of replacing the independent kindergarten 
programs. 

During-the 1971-72 school year Mercer County established 12 Early Chilclr 
hood Education Centers {in existing elementary schootr buildings) which accom- 
modated 474 children who were five years of^atge. As^ r^le/ children fenter 
the first grade in West Virginia's public $choo>s when they are six years old- 
Parents were to send their children to the centersNDn a voluntary basis; i,e., 
the statewide ECEP was not compulsory. The children,\f^*^^ to attend a one-half 
day session each day of a five-day week. 

For the 1972-73 school year the student enrollment gr^to 829; while 
\in 1975-76 over 1>000 students *^we re participating in the ECEP p>:ogram with 
Bore than 20 centers in existence. Parental involvement along with program 
ol^ientation and classroom activity are important, components of the program, 

" . Statement of Purpose . , The purpose of tiris paper' was to present an eval- 
uation (iesign for assessing the Mercer County's ECEP. Due to the* newness of 
the (xregram and to the-neglect on the part of the State Department of Education* 
to provide sufficient guidelines for evaluation* Mercer County has not begun, 
-to utilise any formal type of evaluation toward detertnirring whether or not what 



is expect^ to happen in its ECEP has happened or is happening. Jhus, an 



intent of this paper was to provide a general framework/for evaluation of 

the ECEP which accoinnod&tes all empirical questions regarding the effectiveness 

of the program designed to accomplish specific objectives, 

. * - - « 

Qoals of the Program . Briefly listed below are the Broad goals of the 
program; ' 

1. To l^elop the child's positive self concept jgts ^demonstrated by his 
social' and.emdStional reactions to situations. 

2. To increase his world of people and experiences. • ^ 

3. To develop his emotional stability.^ ^ 

\^ 

4. To enhance his growth in self-reliatice and self-direction. 

5. To assist him in understanding and appreciating our daneqratic way 
of life. - 

6. To develop his skills and competencies in communication and social 
relationships. 

7., To help him think logically as he solves problems related to his 
Experiences- 

8. To increase his competency and skill in physical coordination, 
9- To develop his ap^jreciation for the aesthetic, ^ 

Collection of Data . The time schedule for collecting data is determined, 
in part, by the purpose Of the evaluation. In general, one of the following 
three^^rocedures cap be used to describe any given evaluation data collection 
time schedule as liay^be applied to ECEP; 

1, Data collected at one point iri timej* This schedule allows a comparison 
of the evaluation model expectation and the program at a specified point in time. 
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2. Data collected at two points in time, as exenplified by the classical 
pre- and po9t-test>schedule. This schedule allows an analysis of change and a 
cotnparison of the observed change and the expected change; as defined by the 
model , . 

3. Longitudinal^ evaluatiol^s, generally, collect data at critical points 
over a long period of time (i.e*, more than a year). This schedule allows an 
analysis of change, as in 2 abeve, but with a greater 'degree of sophistication. 



0 

Criteria and Instrumentation . Evaluation, even the most casuaV, matches 
ot?servation to a model and makes a judgment regarding the exactness of fit be- 
tween the two. The model may be clearly defined or it may be loosely defined 
an^t» in fact, tak^ on a definition as a result of the evaluation process 
(Provus, 1971)- In either case, it is necessary. to decide what program vari- 
ables'are to be used to^d&scribe and define the model and the program. These 
variables or objectives set^he criteria which may be used in the evaluation 
of the Cjt^P. The following are examples of variable? which may be used to des- 
cribe models and programs: v 

1* Expected outcomes^in terms^ cfili^dren's behavior'phange or learning 
and development, as indicated in pregrbm objectives^ 

2. Jmplgfnentation of program pV^c^ures, incT^iling: ^ ■ ^; ^ 

A. Staff behaviors (feachers, aides,, etc.) 

B. Materials and equipment available and ways utilized. 

C. Naturae and arrangements of physical space and plant. 

3. Extent and quality of parent and coirenunity involvement^ 

The ECEP evaluation Vay use many types of instruments to collect data. Instru- 
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ments should be appropriately related to, the variables- p .e.V pril^eria) which 
define the model andECEP. The ECEP evaluation may select instruments of the^ 
following general types; , * . 

1. Instruments for use in ttetertnining the progress of the children (cog- 
nitive, affective, and perceptual -motor domains); ^ ' 

A. Standardized tests (group or individual) including achievement, - 
developmental, intelligence, and readiness tests. 

B. Teacher constructed tests. 

Observations by staff, parents, children, specialists and others. 
, D. Interviews and questionnaires (including self-reporting question- 
naire^) completed by staff, children, parents* and specialists. 
E. Children's-'products. 

T 

.21 Instruments for use in determining the effectiveness of the learning 
tenvironment. * * . - 

. A. Observation of organization of the physical pliant and space, 
B. Observations and questionnaires regarding the use of materials 
and equipment. ] 
3, Instruments for use in determining the effectiveness of staff be- 
haviop^ ^ ' ^, 

A. * Observations. % ^ 

B. Interviews. <t 

C. Questionnaires. 

D. Rating scales. 

) 4. Instruments for use 1n determining the quantity and quality of parent 
involvement. * 
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A* Interviews* . ' 

Questionnaires, 
Observations* 

5* Instruments for use In determining the quantity and quality of 
community invplvement, ^ . - 

A, Interviews* 

B* Questionnai res * , 
C. Obsei^vatioris. ' . . 

Analysis of ECEl^ Objectives . Prior to going into the specifics of an 

operational model for ECEP evaluation, the program objectives should be 

/ ■ ^ ^ ' 

Explicated* Following are two illustrations which tend to lend an under- 

standing to the objectives of early childhood education; 



School readineee 
CuGtodial 
Soc ialization — 
Educational 



r 



Perceptual- 
mo tor 



^ Inter per Gonal 



T 

.abb] 



Language 



Program 
— objectiveG 
(examplee) 



Intermediate 

objectiveG 

(examples) 



Labeling DiGcrimatdon 
(Analysis of objectives of individual programs) 



j Instructional 

ClasGif ication objectives 

(examples) 
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Cognitive <- 



Affective 



-> Psychomotor 



Problem solving — Achievement, motivation — 'Running 
Creativity. 



Process 
(Means , 

procedures , Language — 

methodology) 

Reading 



Content 



Mathematics — Morality 

Science Religion 

Social stijdles Ethnic pride 

Art « CulSiral pluralism 

Music * — — Self-knowledge 



— Writing 



Persistence — — t Balancing 

Delay of gratification — Talking 

Intra-personal 

In t erp er sona 1 , * 
Self -ac tual Izat Ion 
Autonomy 
Adjustment 



Products 
(Perfgxmance 
ends , go^s , 
objectively) 



(Analysis of intermediate pbjectives — representative) 

Generating Alternatives . Stufflebeam (1971) notes that altrfirnatives may 
be^efined 1n two ways, either explicitly or implici tly, by statin|(ia rule , 
which could be used to generate all possible relevant alternatives. ^'Decision 
makers must exercise Judgments in determining how many alternatives should be 
generated for consideration and what level of resources Should be expended in 
generating them. ^ ^ ^ ~ 
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Deci^ion-maki ng > Decision-making, according -to Stuff3ebi&am, Includes 
four stages: 1.) Becoming ^ware that a decision Is needed, 2.) Designing the 
situation, 3.)- Choosing among alternatlvj&s, and 4.) Acting upon the chosen ^ 
alternative. 

The deCision^maklng process must be kept in mind "throughout the evaluation^ 
of the ECEP. Planning decisions sbould be viewed as occurring 1n^ general set- 
tings, while structuring* Implementing, and recycling decisions should be viewed 
as occurring in specific homeostatic, incremental, or neomobilistic settings. 

An ECEP Evaluation Model . Following on page 8 is a model which illustrates 
the chief components needed for evaluating the ECEP. This wr1teir<^Eloes not pur- 
port tha^he model is, inclusi^. Other areSs of the ECEP, e.g., ph^ical space 
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utilization, could be Included in' the model. However* the model does include 
the essential components jwhicfi are needed for an empirical evaluation. -tOepen- 
dent upon the nature of the educational program betng evaluated, the components' 
vary from one evaluation to another. ^^^^^^^.^^ ;7 

It should bfr noted ,that the evaluation of the HCEP has to be an ongoing 
process. It will be more formative than suninative evaluation^^^^evertheless* 
since no formal evaluation has been^one thus far with the ECEP» summative 
results for the 1971-72 and 1972-73- school years will represent a starting 
point for the evaluation procedures. . It cannot be over emphasized that decision- 
making has to be taken into serious consideration at the beginning of -the evalu- 
ative process. " ' 
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AN ECEP EVALUATION MODEL 
DATA COLLECTION V CRITERIA 



ALTERNATIVE 



DECISION 



Student 



Affecti ve 



Cogni tive 



Psychomc^or 



Classroom Behavior 
Inventory (CBI) 



Illinois Test of 
Psycholinguistic 
Abilities (ITPA) 



Gesell Developmentarl 
Designs (GOD) 



^ .01 level of signif- 1. Correlate with 1. Use 1n future 

icance on most of 12 other scores ^ measurement, 
subscales. Pre-post Cognitive). 2. Oiscard; 

test design. 2. Eliminate test >tema. 



Score of 60 months 1- Comparison between 
or more, subtests. ^ 

Pre-post test design. 2. Give another test. 

National average for 1; More teaching in 
5-year olA. Pre- psychomotor, 

post test design. 2. Unsupervised physi- 
* ological ''^play. 



1. Formative. 
Summative.' 

2. Favorable. 
Unfavorable. 

1. Formative.' 

2. Sinmative. 

1. Favorable. 

2. Unfavorable. 



Learni ng 
Materials 



Effective Use 



Observation 
Questionnaire 



75% constructive 
utilization 



1. Eliminate. 

2. Combine material • 

3. Revise material. 



1. Favorable. 

2. Unfavorable. 
1. Formative. 
'2. Sunmative. 



Faculty 



Excellent 

teaching 

performance 



Observation 
Questionnaire 
Rating scale 



85% expectation 



1 . Alter approach. 

2. Revise curricQlum. 



1* Retain. 
2. Replace. 
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Participation Observation 
and under- Questionnaire 
standing 



Parental 
Involvement 



70% of parents 



1. Increase publicity. 

2, Program orientation. 



1. Favorable. 

2. Unfavorable, 
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Political Iffltnications . Due to the fact that the ECEP is a state-funded 
project, it is inevitable that certain political pressures from the local 
school board and State Departtnent of Education will* be inferred upon the 
evaluators^of the projgram. Many times certain administrators want a "rosy" 
presentation of their programs rather than an objective, real assessifient. 
'Thus, an outside consultant (evaluator) should play the role of conducting 
the evaluation or evaluating the evaluation* 

Conclu&ion > Teachers responsible for the learning experiences of children 
will evaluate each child in terms of his progress toward specific objectives. 
Students, too, will make Judgment&^bou4;-44u^th&y-liave learned and the extent 
to which they have accomplished that which they^xpect to attain. Parents wil^ 
evaluate the outcomes of the program in tejprtis of what they think their children ' 
are or are not achieving. , , 

To perform the' necessary functions, the evaluation program at all levels of 
the ECEP must: ' \ 

1.. Be consistent with the objectives Lf the program. 

2, Be as comprehensive in^ scope as are the obJecti>tes of the program, 

3. ,Be sufficiently diagnostic to distTnguish various levels of performance 
or mastery. attained and describe the strengths and weaknesses in the processes 
as well as in the product of the performance, 

,4, Have validity, the capacity of the^vid^nce to describe what it was de- 
signed to describe. (Validity must take precedence over econoiny of time, ease 
of ariministration, etc.) 

' 5. Organize the evidence secured from different instruments and on different 

iO 
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.aspects of the evaluation program into a total pattern ^- a meaningful por- 
, trait of individuals, and groups, separate entities and coordinated wholes. 
6. Be"" a continuous process and an integral part of the development and 

y 

improvement of the ECEP. . ' ^ ^ 

Evaluation at any level ^'ancj by any category of people is thus conceived 
as an intricate and complex beginning with the formulation of objectives. 
It involves decisions about the means of securing evidence on the achievement 
of these objectives, the process of inte^iretation of meanings of the evidence 
and judgments about the strengths and >tfeakne$ses of participants and partici- 
pation 1n the P5^gr£tm components. The end result is decTsions about the needed 
changes and improvements in the program. 



\ 
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